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Abstract 

' We study the effects of fast spatial movement of molecules on the dy- 

Ph . namics of chemical species in a spatial heterogeneous chemical reaction 

' network. The reaction networks we consider are either single- or multi- 

scale. When the dynamics is on a single-scale, fast spatial movement has 
the single effect of averaging the dynamics over the distribution of all the 
species. However, when the dynamics is on multiple scales our findings 
show that the spatial movement of molecules has different effects depend- 
ing on whether the movement of each type of species is faster or slower 
then the effective dynamics of the reaction system on this molecular type. 
We assume the reaction dynamics separates into a fast subsystem of reac- 
' tions with a stable stationary probability measure and a slow subsystem 

, on the time scale of interest. We obtain results for both the case when the 

' fast subsystem is without and the case with conserved quantities, where 

, a conserved quantity is a linear combination of fast species evolving on a 

' slower timescale. 

.J 1 Introduction 

X\ 

I When chemical species react, they are present in some (open or closed) system 

with a spatial dimension. Most mathematical models of chemical reaction sys- 
tems describe the evolution of the concentration of chemical species and ignore 
both stochastic and spatial effects inherent in the system. This can be justified 
by law of large number results when both: the number of species across all 
molecular types large, and when the movement of molecules within the system 
is much faster than the chemical reactions themselves. In applications where 
these assumptions hold, the system is spatially homogeneous, and the use of the 



determ inistic law of mass action kinetics is approximately appropriate (|Kurtz 

mi). 
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However, in biological cells, low numbers of certain key chemical species in- 
volved in the reaction systems result in appreciable noise in gene expression and 
many regulatory func tions of the cell, and lead to c ell-cell variabi l ity an d differ- 



ent cell fate decisions ( McAdams and Arkin 1997], Elowitz et al. 2002l |). In or- 



der to understand the key effects of intrinsic noise in chemical reaction networks 
on the overall dynamics, one needs to derive new approximations of stochastic 
models describing the evolution of molecular counts of chemical species. Fur- 
thermore, the cell is not a spatially homogeneous environment, and it has been 
repeatedly demonstrated that spatial concentr ation of certain molecules play s 
an important role in many cellular processes ( Howard and Rutenberel 20031 ] . 
Takahashi et al.l |20inl ]). Deterministic spatial models (reaction-diffusion PDEs) 



are insufficient for this purpose, since it is clear that local fluctuations of small 
molecular counts can have propagative effects, even when the overall total num- 
ber of molecules in the cell of the relevant species is high. 

Numerical simulations of biochemical reactions are indispensable since the 
stochastic spatial dynamics of most systems of interest is analytically intract- 
able. A number of different simulation methods have been developed for this 
purpose, ranging from exact methods (accounting for each stochastic event) to 
approximate methods (replacing exact stochastics for some aspect s of the sys- 



tem with approximate stat i stical distributions), (see for example iFange et al 



2O10l ]. lDrawert et all |2010l ]. ljeschke et all [201ll ]1. For effective computations a 



mesoscopic form of the full stochastic spatial reaction model is necessary. These 
are essentially compartment models in which the heterogeneous system is di- 
vided into homogeneous subsystems in each of which a set of chemical reactions 
are performed. The molecular species are distributed across the compartments 
and their diffu s ion is modeled by moves between neighboring compartments 



(jBurrage et al.l |201ll ]V 



An important mathematical feature of models of biochemical reactions lies 
in the essential multi-scale nature of the reaction processes. In some cases, all 
chemical species are present in a comparable amount and change their concen- 
trations on the same temporal scale. We call this a single-scale reaction net- 
work. However, if at least one chemical species changes its abundance (relative 
to its abundance) on a much faster timescale, we call this a multi-scale reaction 
network. The fast change of the concentrations of some chemical species then 
has an impact on the dynamics of the slow species. When one adds spatial 
movement of species into the system, then the species with fast movement can 
have an averaging effect on the dynamics as well. The overall dynamics depends 
on how these two averaging factors interact, and subsequently determines the 
evolution of the slow species on the final time scale of interest. 

In this paper we analyze the effects of movement of molecules on the dy- 
namics of the molecular counts of chemical species. We consider a finite number 
of compartments in which different reactions can happen, with species moving 
between compartments, and derive results for the evolution of the sum total 
of molecules in all compartments. We consider the following for chemical reac- 
tions within compartments: (i) single-scale chemical reactions, (ii) multi-scale 
chemical reactions without conserved quantities and (iii) multi-scale chemical 
reactions with conserved quantities. We focus on the derivation of simplified 
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m odels obtained as l i mits of rescaled v e rsions of the origin al model (in the spirit 
of iKang et all |2012l ]. iBall et alJ [20061 ] . iFranz et al.1 [20121 ]^ . We stress that our 
results are for mesoscopic models of spatial systems, as opposed to models in 
which t he number of compartments increases and the size of com partments 
shrinks dBlountl [l994l ]. iKouritzin and Lonel |2002l | . iKotelenezl [l988l |l. 

Our goal is to find reduced models that capture all relevant stochastic fea- 
tures of the original model, while focusing only on the quantities that are easy to 
measure (sum total of molecular numbers for each species) in the system. Our 
results for this reduced dynamics make stochastic simulations almost trivial, 
while at the same time differentiating (being able to detect) between differ- 
ent cases of system heterogeneity and between different relative time scales of 
species movement. 



1.1 Outline of results 

After introducing a model for chemical reactions in Section [2. 11 we first obtain 
results in non-spatial systems. Lemma 12.81 gives asymptotics for a single-scale 
reaction network. In Lemma [2. 151 this is extended to two-scale systems without 
conserved quantities on the fast time-scale. Lemma 12.181 and Lemma 12.201 give 
extensions to three-scale systems and systems with conserved quantities, which 
are needed later in spatial systems. Theorem 13.91 gives the results for spatial 
models of single-scale systems, and results for spatial models of two-scale sys- 
tems are given by Theorem 13 . 141 in the absence of conserved quantities, and by 
Theorem 13.231 in the presence of conserved quantities on the fast time-scale of 
chemical reactions. We also include an example of a single-scale reaction net- 
work with a self-regulating gene in Example 12.111 and an illustrative example 
of a reaction network with two time-scales and no conserved quantities in Ex- 
ample 12.161 We conclude the paper with a discussion of possible implications 
and extensions. 

Remark 1.1 (Notation). For some Polish space E, we denote the set of contin- 
uous (bounded and continuous, continuous with compact support), real- valued 
functions by C{E) {Cb{E), Cc{E)). In general, we write x := {xk)k for vectors 
and X := {xik)i,k for matrices. In addition, x^. is the ith line and x.^ is the kth. 
column of x. We denote by !?(/; E) the space of cadlag functions / C R — >■ i?, 
which is equipped, as usual, with the Skorohod topology, metrized by the Sko- 
rohod metric, dsk- For sets F, F' C E, we write F - F' := {f e F : f ^ F'}. 



2 Chemical reactions in a single compartment 

Before we present our main results on spatial systems in the next section we 
formulate and give basic results on reaction networks in a single compart- 
m ent. Although the non -spatial results are a special case of Theorems given 



m 



Kang and Kurtz 20131 ] , we provide our own version of the proof here since 



our results in the spatial case can then be formulated and proved along similar 
lines. 
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Throughout, we consider a set X of different chemical species, which react in JC 
reactions of the form 

MiGi (j^Diei (2.1) 

with u = (i^ifc)jex,fce/c,^ = i'^ik)iex,keK: e and i^ik = I if I molecules of the 

chemical species i take part in reaction k and ly'-/^ = I if reaction k produces / 
molecules of species i. In the chemical reaction literature C = — is called 
the stoichiometric matrix of the system, and Xliex order of reaction k. 

In addition, we set C.^ := (Ctfc)iex- 

2.1 The Markov chain model 

Denoting by Xi{t) the number of molecules of species i at time t, we assume 
that {2L{t))t>o with = {Xi{t))i^x is solution of 

Xi{t) = Xi{Q) + C.fc^ ( f A^^(X(u))d«) (2.2) 

where the F's are independent (rate 1) Poisson processes and K^^{X(u)) is the 
reaction rate of reaction k at time u, k & IC. We will assume throughout: 

Assumption 2.1 (Dynamics of un-scaled single compartment reaction net- 
work). The reaction network dynamics satisfies the following conditions: 

(i) The reaction rate x A^^(x) is a non-negative locally Lipshitz, locally 
bounded function, G /C. In order to avoid trivial arguments, we assume 
that A^^ y^O,kelC. 

(ii) For Poisson processes (^fc)fceA:) the time-change equation (|2.2p has a unique 
solution. 

Remark 2.2 (Mass action kinetics and (12. 2p ). 

1. Probably the most important chemical reaction kinetics is given by mass 
action. In this case, 

^^''{x) = K,r\u,,\(''') (2.3) 

for constants k^. In other words, the rate of reaction k is proportional to 
the number of possible combinations of reacting molecules. 

2. Solutions to (|2.2p can be guaranteed by using e.g. lEthier and Kurt j . [l986l . 
Theorem 6.2.8 ]; see also their Remark 6.2.9(b). 
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2.2 The rescaled system 

Chemical reaction networks in many applications involve chemical species with 
vastly differing numbers of molecules and reactions with rate constants that also 
vary over several orders of magnitude. This wide variation in number and rate 
yield phenomena that evolve on very different time-scales. Recognizing that 
the variation in time-scales is due both to variation in species number and to 
variation in rate constants, we normalize species numbers and rate constants by 
powers of a parameter N which we assume to be large, and consider a sequence 
of models, parametrized by € N. The rescaled versions of the original model, 
under certain assumptions, have a limit as — t- oo. We use stochastic equations 
of the form p. 20 driven by independent Poisson processes to show convergence, 
exploiting the law of large numbers and martingale properties of the Poisson 
processes. In addition we rely heavily on the stochastic averaging methods 
that date back to Khasmi nskii, f or wh ich we follow its formalism in terms of 



martingale problems from iKurtd 1992l |. 



We rescale the system as follows. Consider the solution (X (t))t>o of (12. 2p 

v'^^ replaced by A^^ 



with the chemical reaction rates AP^ replaced by A?^'^. For real- valued, non- 



negative 

a = {ai)i(zx, §_={h)k£K: 7, (2-4) 

we denote the (a, /3, 7)-rescaled system by 

y.^(t) := N~^^Xf{N^t), i € I. (2.5) 

We assume that (a, /3,7) is chosen so that, V/^ = 0{l),i S I for all time (a.s. 
does not go infinity in finite time, but also does not have a.s. zero limit for 
all time). Moreover, we will occasionally restrict to the case 7 = which can 
always be achieved when considering = -|- 7, /c G /C. The reaction rates 
satisfy the following: 

Assumption 2.3 (Dynamics of scaled single compartment reaction network). 
There exist locally Lipshitz functions A^^ : M"^ M+, k £ K. with 

iV-Z^'^Af '■^((iV"»z;,)^ex) X^'^iv) (2-6) 

uniformly on compacts. (In the sequel, we will without loss of generality assume 
that the convergence in (j2.6p is actually an identity. Our results easily generalize 
by the assumed uniform convergence on compacts.) 

Remark 2.4 (Mass action kinetics). Recall from Remark 12.21 the special form 
of mass action kinetics. Here, if = 1 for all i € X and Kk = Klf^N"^'^^^^^^'^'^ 
with = \ and some > for all k € /C, then 



The polynomial on the right hand side is known in the literature for determin- 
istic chemical reaction systems as the mass-action kinetic rate. 
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Let — be the diagonal matrix with ith diagonal entry N °' . The (a, /3, 7)- 
rescaled system (Z^(t))j>o, given by V^{t) = {Vf{t))i^i = N^^X{N^t) is a 
solution to the system of stochastic equations 



7) 



In vector notation, we also write 



V^{t) = V^{0) + N~-C.k^k (iV^*+^ r A^^(Z^(n))du) . (2.8) 

jfce/c 

Note that Assumption 12.11 ensures that this equation has a unique solution. 

Remark 2.5 (Generator of y_^). In our proofs, we rely on martingale tech- 
niques. For this reason, we frequently use the generator of the process 
(Z^(0)t>o- Here, L^ : Cb{Rl) ^ C(M^) and for geCb{M.l), 



=Ar-/3fcACR.JV(Ars.t,) 
Under our assumptions on the rescaling, 

9{Y!'{t))-9{v!'m - f L''g{v!'{u))du 

Jo 

is a (local) martingale for all g € Cb(M^). 



(2. 



2.3 Single scale systems 

For i £ Z, set 

ICi:={kGlC: Cik / 0}, 

which is the set of reactions which change the number of species i. (Note that 
a reaction of the form A + B ^ A + C does not change the number of species 
A.) We say that a chemical reaction network (in one compartment) is a single 
scale system if (a, (5, 7) from (12. 4p satisfy 

max + 7 = , (2.10) 

For i € X, let fC* C /Cj be the set of reactions such that /3fe + 7 = ctj , and let 
/C* = Uiex/C*. Define C by 

a = lim N-^'N^^+^Qk. (2.11) 

Then (^* is the matrix whose z G X, A; E /C* entries are Qk and its i € X, /c € 
ICi — K,* entries are zero. Let Xq be the subset of species with ai = 0, called 
the discrete species, and let /C* = Ujgj^/C* (called the slow reactions). Let 
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slow reactions 


fast reactions 
fcG/C:,/3fc >0 


discrete 
species, 
ai = 0,i e To 


fG(0,oo), keJC* 
1 = 0, else 


Cik = Qk = 


continuous 
species, 

> 0, « G Z, 


Cik = or 

+ 7 - < 

=^ Qk = 


1 = 0, else 



Table 1: We present an overview of the different sets and possibilities here 
in the case 7 = 0. The set I is split into discrete and continuous chemical 
species, while the set /C* is split into slow and fast reactions. The gray boxes 
give the reactions which still appear in the limit dynamics. A special feature 
of single-scale systems is that discrete species are exactly changed through slow 
reactions, and continuous species are changed by fast reactions. In particular, 
discrete species are not changed by fast reactions. This is different in multi-scale 
networks; see Table [2j 



X, be the subset of species with Oi > (called the continuous species), and 
let /C* = Ujgx./C* (called the fast reactions), so JC* = /C* U /C*. Note that 
by definition Xq and X, are disjoint, and by definition of /C*, consequently /C* 
and /C* are also disjoint. Then in the limit of the rescaled system the species 
indexed by Xq are -valued (hence we call them discrete species), while the 
species indexed by X, are R+-valued (hence called continuous species). See also 
Table [T] for an overview of our notions. We must assume the following: 



Assumption 2.6. (Dynamics of the reaction network). For Poisson processes 
{Yk)k€lCii time-change equation 

m = w)+ E QkH + E Qk f >^?'{y{n))du 

(2.12) 

has a unique solution V_ := {y_{t))t>o. 

Remark 2.7 (Reformulation of (j2.12p ). Actually, the last display is shorthand 
notation for 

V,{t) = V^{0)+Y, Qkyk{ f \f'{V{u))du), iGX°, 
Vm = V-(O) + E Qk f A^^(H^))dn, i G X', 
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which shows that species i is either driven by Poisson processes (5^fc)fceK:* ^iid 
thus discrete, or continuous. 

Lemma 2.8 (Convergence of single-scale reaction networks). Let := 

(y^(i))(>o be the vector process of rescaled species amounts for the reac- 
tion network which is the unique solution to ()2.7p . Assume that (q, /3,7) 
from ()2.5p satisfy ()2.10p . i.e. we are dealing with a single-scale system. Sup- 
pose y^(0) =^ V{0) and the Assumptions \2.3\ and \2.6\ for the rescaled reaction 

network are satisfied. Then dskiY_^ ,V_) ^^°°> in probability (in particular, 



V 



y_), where V_ is the solution of (I2.12p . 



Remark 2.9. The proof is an extension of the cl assical Theor e m for c onver - 
gence of Markov chains to solutions of ODEs, see iKurtzl |l97nl |. lKurtj |l98ll ]. 



or 



Ethier and Kurtj |l986l ]. For recent related resul t s con cerning convergence 



to piecewise deterministic processes, see lFranz et al.l |2012l | 



Remark 2.10 (Approximately constant species). In (j2.10p . we could also have 
required that '<' holds instead of '='. However, all practical examples have the 
property that equality holds for all i ^ X. Otherwise, for large N , species for 
which '<' holds in (I2.10p are approximately constant and may be neglected. 

Proof of Lemma \2.8[ Without loss of generality, we set 7 = in the proof. 
First, we will assume that the functions A^^ are globally bounded and globally 
Lipshitz continuous. Then, we will use a truncation argument to show the 
assertion for local boundedness and local Lipshitz conditions. So, for A^^ < A, 
and Yk{t) := Yk{t) — t, we set 



SNit) := sup V!'{u)-V^{0) - CM rA^i^(y^(.))d. 

0<u<t 

Y.cJ A^^(z^(s))d. 



such that 



£N{t) < ^ sup 
kGK-K* 



N-%^Yk{NP'^ \'i\v!'{s))ds) 
+ E \C,-N-H.,\-Yk[r \f'{Y!^{s))ds) 

fegA^o — — 



0<u<t 



+ E ^^p 

, ^1,, 0<u<t 

I 1 first term on the right hand side converges to in L^ since Oj > /3fc for all 
i € X, /c G IC — JC* and A^^ is bounded by A. The second and third term converge 
to by (j2.1ip and boundedness of A^^. Finally, the fourth term converges to 
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since it corresponds to a sequence of martingales wi th bounded j umps whose 
quadratic variation converges to (see Theorem A.l in lKang et al.l 2012l |). Now 
we can write, for some global Lipshitz constant L' , 



E[\v^{t)-v{m < n\v''{o)-vm]+neN{t)] 



Nt 



fce/cs 



<E[|Z^(0)-Z(0)|]+E[e^(t)] 



ACR(y^(n)-ACR(H«)|c/u)) 



+ E ^'ICJ tn\V''in)-V{n)\]du. 

k&K* 



By Gronwall's inequality we see that 



N^oo 



> 0. 



From this convergence in probability of one-dimensional distributions we easily 
conclude convergence in probability of finite-dimensional distributions and thus 

y!" ^f,, V. 

Next, we show tightness of ( V'^)n- By standard arg uments (see e.g. Theo- 
rem 4.8.2 and Corollary 4.8.6 of lEthier and Kurta . 119861 ) . we have to show the 
compact containment condition as well as the convergence of generators. For 
the compact containment condition, by considering supo<u<t \V^{u)\ on the 
left hand side of ()2.12p , and bounding the integrands by L" supQ<„<j |Z'^(n)| 
on the right hand side for some L" (which is independent of N), we obtain that 



E[ sup \V'^{u)\] < E[V{0)\] + L"E[ sup \\r {u)\] 

0<u<t 0<u<t 

implying by Gronwall's inequality that sup^ E[supo<„<f |ll^(w)|] < oo and for 
every e > there is K such that 

supP( sup \V^{u)\ > K)<e. 

N 0<u<t 

We are left with showing convergence of generators. For this, let be the unit 
vector in direction i E Z, and 



lim L^'fiv) = hm N^'^k'^iv) [fin + N~H.,) " f{v)] 

keK~K* 

+ N^^X^^{v)[fiv+ N-'^'Qke^ - f{v)]] 
= Lfiv) 
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Note that - on the right hand side of the first equaUty - in the first sum that 
is over A; € /C — /C* for all i G X we have > /3fc; in the second sum that is 
over fc G /C* for all i G T, we have a, > 0; and in the last sum over G /C* in 
order to have (j2.10p for all i G Xq we must have dk = 0. Hence, we have shown 
convergence in probability of one- dimensional distributions a s well as tightness 



of {y_^)N, so from Lemma A2.1 of lDonnellv and Kurtd [l996l |. we conclude that 

dsk{V^,V) in probability. 

Let now A^^ be only locally bounded and locally Lipshitz. By Assump- 
tion l2.6l for every e > there is a compact set L^ such that P(supo<„<t G 
Te) > 1 - e. Now, change A^^ to A^^, such that A^^ = A^^ on B^Ts) (the 
compact e-ball around F^) and A^^ is globally bounded and globally Lipshitz, 

k G IC. Moreover, call V_ and V_ the (unique) processes in (12. 7p and (I2.12|) . 

with A^^ replaced by A^^. We have already shown that dskiY. ^^°°> in 
probability. We can now write 



lim P{dsk{V^,V) > e) < F{V i Y,) + lim P(d5fc(Z^,Z) >e)<e 
and the assertion is proved. □ 



Example 2.11. (Self-regulating gene). We give a simple example of a single- 
scale reaction network which leads to a piecewise deterministic solution; recall 
also Table [TJ We consider a self-regulating gene which is modeled by the set of 
reactions 



1 : 


G + P^ 


G' + P 


2 : 


G' ^ 


G 


3 : 


G' % 


G' + P 


4 : 


< 

P 






where G is the inactivated gene, G' is the activated gene (hence G + G' is con- 
served by the reactions), and P is the protein expressed by the gene. Here, i 
describes is activation of the gene by the protein, 2 is spontaneous deactiva- 
tion of the gene, 3 is production of the protein by the activated gene and 4 
is degradation of the protein. We consider x = {xg,xg',xp) and the reaction 
rates 

A^^{x) = k[xgxp, AJ^(x) = k'^xg', 

A^R(x) = k'^xg' , A4 ^(^) = <xp 

and the scaling og = og' = 0, ap = 1, i.e. lo = {G, G'} and X, = {P}, as well 
as 



/3i = 0, /3, = 0, /3, = 1, f3^ = l, 

I 

3 — ^•■"i ■"4 
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such that (compare with ()2.6p ). with vq = xg,vqi = xqi,vp = N ^xp, 

\^^{v) = KlVGVp, A^^(u) = 

{v) = K3VG' , (v) = K^vp . 



Here /C* = K-g = ^G' = and /C* = Kp = {3,4}. In this example, the 

matrices Q and C,* are given by 

G /-I 1 
( = = G' 1 -10 
P \ 1-1, 

Moreover, according to Lemma [2^ the limit {V_{t))t>Q of {V^ {t))f>Q solves 
VG'{t) = Vg'{^) + 1^x(k, j'^ VG{u)Vp{u)du) - Y,{k^ VG'{u)du) , 
Vp{t) = Vg(0) + [ VG'{u)du - K4 / Vp{u)du. 



^0 

2.4 Multi-scale systems 
Two-scale systems 

We say that the chemical network (|2.1|) is a two scale system if (a, /3, 7) from 
(|2.4p are such that: there is a partition of Z in (disjoint) (referred to as the 
set of fast species) and X'* (which are called the slow species) such that, for 
some e > 0, 

max /3fc + 7 = + e, i 

^"^^^ (2.13) 
max + 7 = a j , i G 

We will without loss of generality assume, as before, that 7 = 0, and that our 
choice of N is such that e = 1 in ()2.13p . so the relative change of fast species 
happens at rate 0{N) and the relative change of slow species happens at rate 
0(1). 

We first consider what happens on the single faster time scale N dt. For 
each i G I-^ , let K.{ C /C,, be the set of reactions with (3^ = a, + 1. Define 

}C-f = {k e }C : 3i £ 1^,^ = Oi + 1}, (2.14) 

and a matrix C,^ with rows and \lCf\ columns defined by 

= lim 7V-(°»+i)iV'^'=CiA:, i e X^, A; G /Cf . (2.15) 

This matrix identifies a subnetwork of reactions and their effective change on 
the faster time scale N dt. Let x/ C if be the subset of fast species for which 
ai = 0, and let /Co = U ct/^/ be the subset of reactions changing discrete 

valued species on this time scale. Let x/ C if be the subset of fast species 



2 
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Table 2: As in the single-scale case, the set I is split into discrete and continuous 
chemical species. In addition, discrete and continuous species are either changed 
on the fast or slow timescale. (This means that are disjoint sets.) 

The set of reactions is split into several categories, which can also overlap. Here, 
is a reaction which changes a discrete species on the fast timescale etc. 
Note that such a reaction can as well change a continuous species on the slow 
timescale. The separation of fast and slow time scales is determined by ()2.13p 
with 8 = 1. As in Table [H we mark the cells which finally determine the 
dynamics of the limiting object. 
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for which > 0, also called continuous species on the fast timescale and let 



K,i = U pT^ subset of reactions changing continuous valued species 



on this time scale. Since ll and xl are disjoint in =xl UXl , and since 13k 
is unique for each reaction in K.^ = ICl U K-l, it follows that /Co and ICl are 
disjoint as well. 

We next consider what happens on the single slower time scale dt. For each 
i € Z^ let 

IC' = {kelC:3ieX',^k = ai}, (2.16) 
be the set of reactions such that f3k = ai, and = (C4)«ei'',fcGA:'= defined by 

a = lim N-'^^N^^Qk, ier,keJCt. (2.17) 

This matrix identifies the subnetwork of reactions and their effective change on 
the slower time scale dt. Let C X^ be the subset of (discrete) slow species 
for which Oj = 0, and /C^ = Uiexi ^1 subset of reactions changing discrete 
valued species on this time scale. Let X^ C X be the subset of (continuous) slow 
species for which ai > 0, and ICl = ^iex^^t the subset of reactions changing 
continuous valued species on this time scale. As before, X^ and X^ being disjoint 
in X^ = X^U XI implies that /C* and /C* are disjoint in /C* = /C* U /C* as well. 

Note, however, that there is no reason for to be disjoint from K,^ . In fact 
there may be reactions in K,^ with parameter /J^ that make an effective change 
on the time scale dt in a slow species of high enough abundance ai = 13k, that 
also effectively change some fast species on the time scale N dt, i.e. for some 
j G X^ with Pk = aj + 1. The important factor for limiting results is that we 
identify contributions from reactions on each of the two scales independently, 
and make assumptions on their stability. 

Remark 2.12 (No generator convergence for fast species). As in the single- 
scale case, we rely on martingale techniques and generators in our proofs. Here, 
the generator L^ of the process iV^ {t))t>Q is given for g G Cfe(M^) by (j2.9p . 
For chemical species i £ X^ and k £ JCi, we have 13k = ai + 1. Hence, if g in (|2.9p 
depends on Vi, the term 

N^'X^'^iv) [gin + A^--C.fc) - 9{v)] (2.18) 

does not converge for all v as N ^ oo. However, if g only depends on (f.t).tgjs, 
then (j2.18p is zero and it can be possible to obtain a proper dynamics of the 
slow species. This is the content of Lemma 12.151 

Remark 2.13 (Conserved quantities). Our initial division of species into fast 
and slow may include some conserved quantities, that is, there may be linear 
combinations of fast species that remain unchanged on the faster time scale 
Ndt. Let MiiC^Y) be the null space of {C^Y- If its dimension is > it is 
formed by all the linear combinations of species conserved by the limiting fast 
subnetwork, meaning that they see no effective change on the time scale N dt. 
Probably the most prominent example in this class is Michaelis-Menten kinetics 
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(see e .g. Section 6.4 of iKang and Kurta 2013l | and Section 5.2 of iKang et al 



2012l |). We will discuss this in forthcoming work, and will see this feature 



also appearing in all spatial models in the next section. In spatial systems the 
fast species are counts of species in a single compartment (which evolves due 
to both, movement and chemical reactions) while conserved quantities are the 
sum total of the coordinates in all compartments (which evolves only according 
to chemical reactions) . For now we assume that the basis for the species is such 
that dim{J\f{{C-^Y) = 0. 

Define the fast process to be = {Vj {t))t>o, Vf{t) = (^i^(t))iex/ and 
the slow process to be = (Zf (i))t>o, Vf{t) = (V;^(t))iej. . We now give 
necessary assumptions on the dynamics of V_J on the time scale N dt conditional 
on (t) = Vg being constant, on the dynamics of , and on the overall 
behavior of in order to obtain a proper limiting dynamics of slow species, 

yN 
—s 

Assumption 2.14 (Dynamics of a two-scale reaction network). Recall A^^ 
from ()2.6p . The two-scale reaction network (j2.13p with effective change as 
in (j2.15p on time scale N dt and as in (j2.17p on time scale dt satisfies the 
following conditions: 

(i) For each G there exists a well defined process Y_j\^ , giving the 

dynamics of the fast species given the vector of slow species, that is the 
solution of 

Vfl.Jt) = Vf\^2^^)+ E iiM f ^k''{Vf\vJn),v,)du 

f J 

f I' 



(2.19) 



\xf\ 

with a unique stationary probability measure fi^^ {dz_) on i such that 
>^k''{vs) = A^^(z,2;J/i.^(dz) < oo, kG K'. (2.20) 

(ii) There exists a well defined process that is the solution of 

Vsit) = Zs(o) + E ( /* >^f'iys{u))dv 



2.21 



with A^^ given by (I2.20p . 

Ixi 

(iii) There exists a locally bounded function t/; : W^' ^ R, ■0 > 1 such that 
ip{x) oo as X ^ oo, and 
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(iii-a) for each t > 



(iii-b) for all A; G /C 



supE 

N 



< oo; 



lim sup , ' = 0. 



The following Lemma can also be read off from [Kang and Kurta . l2013l . Theo- 
rem 5.1] . The proof is again given here since proofs which follow are of a similar 
style. 

Lemma 2.15 (Convergence of two-scale reaction networks). Let := 

(y^(i))(>0 be the vector process of rescaled species amounts for the reaction net- 
work which is the unique solution to (|2.7p (or ()2.8p ). Assume that (a, /3, 7 = 0) 
satisfy (j2.13p for some and e = 1, i.e. we are dealing with a two-scale 

system. Suppose (0) V^(0) and the Assumptions \2.14\ are satisfied. 

Then the process of rescaled amounts of the slow species (•) converges weakly 
to the solution V_g{-) of ()2.2ip with rates given by (|2.20p in the Skorokhod topol- 
ogy- 
Proof. Let be the occupation measure of the rescaled process, i.e. the mea- 
ixi 

sure on W^' x [0, 00) given by 



T^{D X [0,t]) = I lD{Y!\u))du 



Then, condition (iii-a) in Assumption 12.141 implies that {F : G N} is rel- 
atively compact. Moreover, for any continuous function g : 
fying limA-^ooSup t,,|^ft- 



satis- 



Kang et all [2012l |^ 



we have (see, for example, Lemma 2.11 of 



g{V^{u))du 



giz)ridzx[0,-]), 



where F is a weak limit point of {L^}. By the same arguments as in the proof 
of Lemma 12.81 {V_^ : N G N} satisfies the compact containment condition and 
we let y_g denote a weak limit point. We next show T and y_g are uniquely 
determined. 

For any function g : 1— )• M of the slow species the process 



Mf'^(t)=ff(Zf(t))- / L^9{Y!^{u))du 

Jo 
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is a martingale, where by (|2.9p L^ is the infinitesimal generator given by 



+ E A^'''=A^^(i;)[5fe + E ^~^'C^ke, + E N""'C^ke,) - g{i 



Let be a linear operator on functions g & : ' 1-^ M of the slow species 
given by 

Lsg{v) = E A^^fe) [9(2!. + C,) - 9ivs)] + E A^^(^)9.,5fe) • 



(2.22) 

Conditions (iii-a) and (iii-b) in Assumption 12.141 together with the definition 
of the slow submatrix imply that for any t > 



iV- 

as well as 



hm E[ sup \M^'^u)-g{V^{u))- L,g{V'' {u'))du'\] = 0, 

u£[0,t] Jo 



supE 

N 



Lsg{V^{u))\du 



< supE 

N 



The stochastic averaging theorem of iKurta 1992l | now implies that for any 
g £Cl: ^ R the process 

M!{t) = g{VM) - f Lsg{z,V,{u))T{dz x du) 
Jo 

1 \x\ \x^\ \x^\ 
is a martingale. Furthermore, for any function g £ : = x ^ ^ 

of all species the dynamics on the time scale dt is given by 
N-'L''g{v)=Y,>^k\vMvf+Y.(^>'^^+ E ^~"'C.fce„ 



i&xi 



i&s-xl 

2^. + E^""'^*'^^^)-5fe)] 

fc6/ci' i&i iexf-xl 

°=i>/5fc-l 

2^s + E^~°'C.fce,)-g(i;)]] 

keJC-Kf iexf 

2^.+ E^""'^*'^^^))-5(2^)]- 

ieX" 
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For any € ' let be a linear operator on functions g £ Cl : RI"^' i-^ 

of all species (effectively changing only the fast species) given by 

Lf\vjiv)= >'k^iil)[9ivf + Ci,Vs)-9illf,Vs)] 



fcg/c{ 



Conditions (iii-a), (iii-b) in Assumption 12.1^ together with the definition of the 
fast submatrix (^'^ and the assumptions on the separation of time scales (I2.13p . 

imply with Zf (0) t;,, 

- <7(Z^(0)) - f^L"" giV!" {u))du) ^ - J Lf\,_^g{vndv x du) 

Rlj^' x[0,i] 

Uniform integrability of the left hand side implies the limit on the right hand side 
is a continuous martingale with paths of finite variation and hence is iden tically 
zero. Condition (i) in Assumption 12.1^ now implies (see Example 2.3 in iKurtz 
1992( 1) that r can be written as 



T{dv X du) = p-v^{dv_j)T^ {dv_g x du) 
The martingale Mf it) can be rewritten as 

Mlit) = giVM - [' Lsg{vf,Vsi^))fi.M^f)^^(dv, 
Jo 



X du) 



Since T-l'{dVg x du) = Sy^(^Q-j{dVg)du, we see that F is unique, and since by (|2.20p 
in Assumption 12.141 we can integrate the rates in the operator equation (|2.22p 
with respect to fi^^ , 

M^{t) = g{Vs{t)) - f Lsg{VAu))du 
Jo 

with Ls a linear operator on functions g £ Cl of the slow species given by 

and rates A^^ as in (j2.20p . Now, condition (ii) of Assumption 12.141 insures 
that the limit of the slow process V_g can be identified as the solution of the 
well-posed martingale problem, namely that y_g is the solution of 



iVg{u))du. 



Vsit) = Vsm + E f >^k''iVsiu))du) + E c, r 

In particular, V_g is uniquely determined. □ 
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Example 2.16 (Two time-scale kinetics in a single compartment). We present 
here an example of a second order reaction with two time-scales. In our exam- 
ple, two species A and B react and give species C. Importantly, B is quickly 
transported into the system and degrades very fast. Precisely, we have the set 
of reactions 

i: A + B^C 
z: ^^B 
3 : B 

Here, the sum of the numbers of molecules A and C is constant (but both will 
turn out to be slow species), so we only need to consider the dynamics of the 
A molecules. We denote molecules numbers by xa and xb, respectively, set 
X = {xa,xb) and consider the reaction rates as given by mass action kinetics, 

Ai^(x) = k^xaxb. A^^(x) = 4, A^^(x) = k'^xb- (2.23) 

For the scaled system, we use a a = cue = 1, = 0. So, setting the rescaled 
species counts 



and 



i.e. with 



we write 



VA = N ^Xs, VB = XB 



/3, = 1, /3, = 1, /33 = 1, (2.24) 



k^ = k'^, k^ = N-^k[, k^ = N'^k'^, (2.25) 



X?^{V) = KiVAVB, X'^^{v) = K2, X'^^iv) =K3VB. (2.26) 

Now, the process = {V^ , V^) is given through (|2.7p by 
V^{t) = V'/(0) - N'^Y,{n j\,V^{u)V^{u)du), 

vg{t) = v^{<d) -y^[n K^yf (n)v^(u)d'u) + y^iVK.t) (2.27) 



From this representation, it should be clear that Vb is fast while Va is a slow 
species. For 7 = 0, e = 1, we have = {1}, /C-^ = {1,2,3}, (hi particular 
/C^ n /C/ / 0) }Ca = {1}, }Cb = {1, 2,3} and If = 1} = {B}, Is = It = {A}. 
The matrices describing the reaction dynamics on both scales are 



k B 
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where the three columns in ( and (-^ give reactions i, 2 and 3 and is a 
1 X 1-matrix since there is only one reaction where A is involved. Note that 
J\f{{C^Y) = {0}, indicating that there are no conserved quantities on the fast 
time-scale. In order to study the dynamics of the slow species, := Va, 
we apply Lemma 12.151 and have to check Assumption 12.141 Here, for Poisson 
processes Y^^Y^ and Y3, and fixed V_g = Va = va, from (I2.19p . 

VB\vAt) - ^BIt-A(O) = -Y,(^J^K,VAVB{u)du^ +Y,{K2t) -Y,(^J^K,VB{u)du^ 
= Y^{K2t) - 11+3 j (l^iVA + K^)VBiu)duj 

for some Poisson process ^1+3 which is independent of 1^2- Note that 
is a birth-death process with constant birth rate and linear death rates, 
proportional to Ki_va + ^3. It is well-known that in equilibrium, Vb\ 



X 



with 



X ~ Poi 



which gives the desired fiy^{dvB)- Hence, (j2.20p gives 



X^I^'ivA) = n^^.VAX] 



K3 -I- Ki_VA 

Finally, Lemma 12.151 implies that in the limit — ?• 00, we obtain the dynamics 



VAit) = VAiO) - / X?''{Vsiu))du = Va{0) 
Jo 

Three time-scales 



KiK2yA{u) 

K3 + KiVa(u 



-du. 



Chemical reaction networks with more than two time-scales also appear in the 
literature. One example is the h eat shock response in Es cherichia col i, intro- 
duced by ISrivastava et al.l [200ll ] and studied in detail bv iKana [2OI4]. Here, 
we state an ext ension of Lemma 12. 151 to reaction networks with more than two 
time-scales (see iKang et al.l [20121 ] ) . Namely, suppose that for some 7 € M the 
parameters a, (3 in (j2.5p and (j2.6p are such that: there is a partition of X into 
disjoint sets X^,!"^,!^ such that, for some 62 > £1 > 0, 



max/3fc + ^ = ai + 62, 
keiCi 

max + 7 = oii + El, 
max/3fc + 'y = ai, 



i G X-f 
iGX"" 

iex' 



(2.28) 



We will assume, as before, that 7 = 0, and that our choice of N is such that 
£2 = 1 in (|2.28p . so the relative change of fastest species Xf happens at rate 
0{N), the relative change of the middle species X^ happens at rate 0{N^'^), 
< ei < 1, and the relative change of slow species I* happens at rate 0(1). 
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Again, we need to consider what happens on each single time scale sepa- 
rately. In addition to earlier definitions, for each i € we let /C™ C /C be the 
set of reactions with Pk = ai + ei, KJ^ = Uiei™ ^T-i ^"^^ ^ matrix ("^ with 
rows and l/C™! columns defined by 

G = lim iV~("'+"i)A^^^Cifc, iel"',ke JC^. (2.29) 

which identifies a subnetwork of reactions and their effective change on the 
middle time scale N^'^ dt, and we let C I™' be the subset of middle species 
for which at = 0, C X"* be the subset of fast species for which Oi > 0, and 
finally /C™ = Ujgjm/C™, and JC^^ = Ujgi^/CT^. We now need an additional set 
of assumptions on the dynamics of V_J on the time scale N dt conditional on 

iy-mit)^y-s^ (*)) — iHrmils) being constant, and on the dynamics of on the 
time scale A^^^ dt conditional on (t) = Vg being constant. 

Assumption 2.17 (Dynamics of a three-scale reaction network). The three- 
time scale reaction network (12.28^ with effective change (12.15^ on time scale 
N dt, (j2.29p on time scale A^"^^ dt and ()2.17|) on time scale dt satisfies the fol- 
lowing conditions: 

(i-a) For each {Vj^,Vg) G there exists a well defined process that is 

the solution of 

f I' 

+ J2^if ^k''iyf\{v^,vj{u),V^,V,)du 
f 

keKi 

with a unique stationary probability measure fi(^y ^, ){dz_) on , such 
that 

A^'^(^^,l^s) = A?^(l,i;^,2;J/^.,(dl) <oo, fcG/C"\ (2.30) 

(i-b) For each G there exists a well defined process that is the solution 
of 




which has a unique stationary probability measure fii,^{dv^) on RI-^""!, 
such that 

A^^'d^J = >^k''iVm,Vs)f^vM^m) < OO, /c G /C^ (2.31) 
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(ii) There exists a well defined process that is the solution of (j2.2ip with A^^ 
given by (pIST]) . 

(iii) see Assumption 12. l41 fiii) . 

The extension of Lemma 12.151 then becomes 

Lemma 2.18 (Convergence of three-scale reaction networks). Let := 
{y_^ {t))t>o be the vector process of rescaled species amounts for the reaction net- 
work which is the unique solution to {2. 7p (or ()2.8p ). Assume that (a, /3,7 = 0) 
satisfy (j2.28p for some Z/,X™,X^ and < ei < £2 = 1, i-e. we are dealing 
with a three time-scale system. Suppose V1''^(0) YSfi) and the Assump- 

tions 2.11 are satisfied. Then the process of rescaled amounts of the slow species 
converges weakly to the solution V_g of h2.21\) with rates given by \2.31\) in 
the Skorokhod topology. 

Proof of Lemma \2.18[ The proof follows the exact same lines of argument as 
before with only the following adjustment when identifying the limiting occupa- 
tion measure P. The assumptions on the separation of time scales ()2.28p imply 
that for any function g G oi all species v 



u))du) 



> 



j Lfi(^^^^^jg{v)T{dv xdu) = 

'■+x[0,t] 



where is a linear operator given by 



+ E >^kHv)dv,9{v)-Ci. 



Condition (i-a) in Assumption 12.171 implies F can be rewritten as 

T{dv X du) = fJ^{v^^^,vjidvf)rf{d{v^,v^) x du) 

An application of the same argument also implies that for any function 9 G 
of only species and Vg 

^ '9{V''it)) - giV^m - f L^giV^iu))du) 



N^i 



Lm\vj{ll)'^{dv xdu) = 
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where L^^^^ is a linear operator given by 



L^ 



J in) 



9{vf,v^ + Cl^Vs)-9{v) 



Since 



/ 



Lm\vahl}T{dv X du) 



Lni\v^g{v)Tf{d{v^,Vs) X du) 



W[o,t] 



«+'x[0,t] 



where is the same hnear operator as L^^^ except with rates A^^ replaced 

by A^^ from (f230D . now condition (i-b) in Assumption 12 . 1 7l implies that F-^ can 
be rewritten as 

(divm^lls) ^ '^^) = P-v^{dy_^)T^''^{dy_g x du) 

Since Tf'"^{dVg x du) = dy (ff^{dv_g)du^ the rest of the proof now proceeds as in 
that of Lemma 12.151 except with the rates A^^ in the definition of the operator 
Lg on functions g ^ oi the slow species now given by 



Conserved quantities 



11/ 1 



□ 



We turn now to the problem of conserved quantities. Suppose we have a two- 
scale reaction network with d\m.{J\f{{C,^Y) =: > 0. Then there exists linearly 

independent Z-valued vectors d_'^^ = . . . ,9'^^f^), i = 1, ...,n^ such that t >-)■ 
{§!^^iY.f\v (*)) with from (|2.19p is constant. In other words, the change of 

(e^'^vflt)) on the time scale N dt goes to 0. We set 9-^ := (^''')i=i,...,n/, i.e. 



J\f{{Cf)') = span(e^) 



(2.32) 



and note that the construction implies that 9^^ has a unique parameter aj 
associated with it, which we denote by a^, i = 1, l©-'^!- 

We assume that the effective changes for these combinations are on the 
time scale dt, i.e. sup^jg^.^^ic, ,j '^^q (3k < a^- In other words, we exclude the 

possibility that they create a new time scale, or that they effectively remain 
constant as then we do not need to worry about their dynamics. This will 
be all we need for our main results on the compartment model of multi-scale 
reaction networks. If they change on the time scale dt we need to consider their 
behavior together with that of the slow species. 

We let = je/| be the vector of rescaled conserved quantities. 

For each i = 1, \Q-^\, let ICg'^i be the set of slow reactions such that (3^ = 
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Uc, and {t\C^^) ^ 0, and let IC" := Ul=i -'C^.- Note that /C^ n /C^ = by 
construction. Let (^^ be the matrix with rows and l/C^j columns defined by 

c;;^ = hm iv-^^^iV'MrNC,), i = i,...,\e^\,keici (2.33) 

Let qI C Q'f be the subset of conserved quantities for which = 0, /C^ = 
[Jgci^Qf )Cg<:i . Let qI C Qf be the subset of conserved quantities for which 
> 0, /C^ = Ugcige/ ^^e'^i- As before /C^ and /C^ are disjoint. We will also 
make the additional assumption that 

ICnlC' = ^ (2.34) 

In other words reactions that effectively change the conserved quantities on the 
time scale t make no effective change on the slow species on this time scale, 
and vice versa. This will be the case in the compartment models of multi-scale 
reaction networks we consider in the next section. 

We can now extend our results under obvious modifications of our earlier 
assumptions, as given below. Note that the dynamics of conserved quantities 
depends on that of the fast species in the same way as the dynamics of the slow 
species does. 

Assumption 2.19 (Dynamics of a two-scale reaction network with conserved 
quantities). The two-scale reaction network ()2.13p with effective change ()2.15p 
on time scale N dt and (|2.17p and (|2.33p on time scale dt satisfies the following 
conditions: 

(i) For each {v_g\v_^) G M!^ ■, He '■= (^^Ci)j=i,...,|0/|, there exists a well 
defined process that is the solution of 

keici 

+ E f ^k''iVf\(v^;v^){^),lls)du 

f 

which satisfies the constraints 

(r%Z/|K,.j)=^^c„ r^GG^ (2.35) 

and which has a unique stationary probability measure .„ ){dz) on 

(concentrated on the linear subspace such that (I2.35P is satisfied), 
such that 

A^''(2!.,2Zc)= /,^, A^^(£,l!j/i(.^;.j(d£)<oo, A:e/C^ (2.36) 
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(ii) In addition to a well defined solution of (j2.2ip . there exists a well defined 
process that is the solution of 

ft 

lu ^ 

(2.37) 



1. ^ v^r. ^ 



fc6/CS 

i.e. 



(2.38) 



where the rates in both ([2:21]) and (p^T]) . (|238]) are given by ([236]) . 
(iii) same as in Assumptions [TT^ 

Lemma 2.20 (Convergence of two-scale reaction networks with conserved fast 
quantities). Let {y_^{t),t > 0) be the process of rescaled species amounts ([2.7p 
for a two-scale reaction network, with a, P satisfying Ii2.13\) . 7 = 0,e = 1, and 
with conserved quantities O'^ = (^'^Oi=i,...,|0/| (which is a basis of the null space 
of i{Cik)ieif ,k&lcfY ) whose effective change is on time scale dt satisfying ^2.34^ . 

Suppose l^^(O) Y-{^) o.f^d Assumptions \2. 1^ are satisfied. Then, we have 

joint convergence of the process of rescaled amounts of the slow and conserved 

quantities {Y_^ {■),y_^ {■)) (]^s(')>l^c(')) Skorohod topology, with 

y_g the solution of 12.21\) and V_^ the solution of 12.31 ) with rates given by 

KM. 



Proof. The proof proceeds in exactly the same way as that of Lemma 12.15] 
except that now we have the martingale problem, for functions g G of both 
slow and conserved quantities {v_g;v_() 

Mi^/(t) = ff(Zf (t)) - f L^cdiY!" {u))du, 

Jo 

based on the joint generator 



+ E^^'A^R(^)[5(l^. + E^"'''c^fce,+ E 
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ac, >0 



In order to understand the form of the generator, recall that IC^ D IC^ = 0. 
Therefore, for all A; € /C'^ we must have > Pk or {6'^\ C ^) = and similarly 
for all /c G /C^ we must have Oi > Pk for all i G Z*, A; € /C^. 

Now let Lg-c be a linear operator on functions g ^ : m}^ '^'^ ' 1— )■ M of 
both slow and conserved quantities given by 



(2.39) 



In addition to the conditions (iii-a) and (iii-b) in Assumption 12.141 and the 
definition of the slow submatrix (^^, the definition of the conserved submatrix 
and the assumption of separation of reaction sets /C^j/C^ (j2.34|) . imply that 
for any t > 

lim E[ sup \M^/{u)-g{V^{u)-V^{u))- / L^.^giv!" {u'))du'\] = 

and by the stochastic averaging theorem, we again have a martingale, for any 
function g ^ C]. oi both the slow and conserved quantities given by 

Mf.e(t) = 5(Zs(i);Zc(i)) - f Ls.cgU,V,i^);V,{t))T{dz x du). 
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Identifying the limiting occupation measure T in terms of ) proceeds ex- 

actly in the same way as in Lemma 12.151 and the above can be rewritten as 

= g{Vs{t);V,{t)) - f L,,,g{V,{u)-V,{t))du 
Jo 

where Ls-c is the linear operator obtained by replacing the rates A^^ in (I2.39P 
by averaged rates A^^ from (j2.36p . In addition to identifying y_g by ()2.2ip . 
condition (ii) insures that V_^ can also be identified as the solution of the well- 
posed martingale problem given by (j2.37p . □ 

It is clear that the result on the limiting dynamics of the conserved quantities 
which change on the time scale dt holds even if we do not have any slow species 
on this time scale, in which case (|2.34p is trivially satisfied. We then only 
have the dynamics of conserved quantities following (j2.38p with the rates A^^ 
obtained using the stationary probability measure for the fast species Hv^{-) 
which depends on the conserved quantities only. Analogously, it is possible 
that the dynamics of conserved species on time scale dt is trivial in which case 
we have the dynamics of slow quantities following (|2.2ip with y_^{u) = v^,u > 0. 
Furthermore, if we have a reaction network on three scales, it is obvious how to 
write the analogous result for the conserved quantities on whichever slower time 
scale their dynamics is. Both of these situations appear in the dynamics of the 
heterogeneous reaction network models, and we have now provided all of the 
tools we need for our results on models with movement between compartments. 



3 Chemical reactions in multiple compartments 

In this section, we assume that the chemical system is separated into a set of V 
compartments, and chemical species can migrate within these compartments. 
For species i G I, movement happens from compartment d' to d" at rate A^^, ^„ . 

3.1 The Markov chain model 

Denoting by Xid{t) the number of molecules of species i in compartment d at 
time t, we assume that {X_{t))t>Q with X_{t) = {Xid{t))i^x,d£V is solution of 



(3.1) 



X^d{t) = X,d(0) + CikYkdi f ACR(Xd(n))dt 

+ ^ iSd",d- Sd',d)Yd',d",i(^ h^^,^^„Xid'{u)di 



d',d"&V 

where X_.^ = [Xi^ji^x and the K's are independent (rate 1) Poisson processes. 
We now assume: 

Assumption 3.1 (Dynamics of un-scaled multi-compartment reaction net- 
work). The reaction network dynamics satisfies the following conditions: 

(i) Same as Assumption 12. IB ) in each compartment and for all k there is at 
least one d with k^f / 0. 
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(ii) For Poisson processes {Ykd)kelc,deT> and {Yi^d',d")iei,d',d"ev, the time- 
change equation (j3.ip has a unique solution. 

Remark 3.2 (Sum totals of chemical species). We stress that for Xi(t) := 
Yldev^idit)^ 

X,{t) = X,{0) + ^ Cik Ykd{ f K'i^{X.M)du) 

^x,(o) + ^Ca.n( fY.^kd{x.Ay^))du) 

k&K •'^ dev 

for some independent (rate 1) Poisson processes (ifc)fceyc- However, since 
T.dev^kd'i^di-^)) generally depends on all entries in ^(s), {{Xi{t))i^x)t>o 
is not a Markov process. 

3.2 The rescaled system 

Consider the solution of (j3.ip with the chemical reaction rates and move- 
ment rates A^^, ^„ replaced by A^J^'^ and A^/^„, respectively. For real- valued, 
non- negative 

we denote the (a, /3, 7, r/)-rescaled system by 

yJ(t):=Af--'X,^(iV^t), iei,dev. 

Again, we will restrict to the case 7 = 0. 

Assumption 3.3 (Dynamics of scaled multiple compartment reaction net- 
work). In addition to Assumption 12.31 within each compartment, there exist 

j^T-v, ^M,N N-*oo -M (or)\ 
^ \d',d" ^ \d',d" ^"^•"'^ 

Again, we will without loss of generality assume that this convergence is actually 
an identity. 



The (a, /3, 7, ry)-rescaled system (t) = N -X_{N'^t) is the unique solution to 
the system of stochastic equations 



+ N-"'iSd",d-Sd',d)yd',d",i{N'''^'''^^ [ 



t 

\,d\d"^id'is) ) • 



(3.3) 
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In addition, (compare with Remark I3.2p . we set 

5^ = {Sn^^I With Sf := J2 y^ 



N 
id ' 



i.e. S*,- solves 



(3.4) 



(3.5) 



k€K dGV 

Remark 3.4 (Heterogeneity of the Reaction Network). Our set-up does not 
preclude the option that different compartments may have different reaction 
networks all together. This is taken care of by accounting for all the possible 
reactions in the stoichiometric matrix and setting the individual compartment 

rates to zero in desired compartments. 

Remark 3.5 (Generator of y_^). The generator of (V^^(i))f>o is given by 



L^'fk) = E E N^'^'^kfivd) [fig + - fig, 

d£V keJC 

+ E T.^'''^''^'^^d',d"^^d'\fig+N~'^x':' )-fig) 



d',d"ev i£X 



where C, ^ is the |X| x jDj-matrix with dth column C, ^ and zero otherwise, and 
is the \X\ X l^l-matrix with its ith row C,. consisting of Qd" = 1, Cid' = ~1 

=i,d' ,d" — 

and zeros everywhere else. 



3.3 Spatial single-scale systems 

We can now examine the effect of heterogeneity on the chemical reaction sys- 
tems via compartmental models. We assume that (j2.10p holds within every 
compartment. The sets I,Zo,I, and /C, /C*,/C* and (* are used as in Section [2j 
We will assume that movement of species is fast, i.e. r]i > 0,i £ I. We first 
make an assumption about the movement dynamics. 

Assumption 3.6 (Equilibrium for movement). For each species i G X, the 
movement Markov chain, given through the jump rates A^, ^„ from d' to d", 
has a unique stationary probability distribution. (This is the case if the Markov 
chain is irreducible.) We denote this stationary probability distribution by 

{■Ki{d))d£V- 

Lemma 3.7 (Movement equilibrium). Let A ssumption \3.6\ hold. 

1. Let i £l be such that Oj = (i.e. i £ Zo). Consider the Markov chain of 
only the movement of molecules of species i, i.e. the solution of 




started with X^(igx> ^rf(O) ~ ^i- Then, the unique equilibrium probability 
distribution of this Markov chain is given as the multinomial distribution 
with parameters (sj; (vrj((i))dgx')- 
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2. Let i & I be such that ai > (i.e. i ^ I,). Consider the limiting deter- 
ministic process of only the movement of molecules of species i, i.e. the 
solution of 

d'ev 

started with Yld&v ^d(O) — Then the unique equilibrium of this process 
is given by {siiri{d))dev- 

We denote the equilibrium probability distribution of movement of all species, 
started in {si)i^x by Ps and by the corresponding expectation operator. From 
the above, is a product of multinomial and point mass distributions. 

Proof. The result is a simple consequence of Lemma [2.20l with sum S_ = Yldev^id 
the conserved species and /C = 0. □ 

We start with the simplest results for chemical reaction networks which are on 
a single scale, and describe the effect of mixing on the heterogeneous chemical 
reaction system. 

Assumption 3.8 (Dynamics of the spatial single-scale reaction network). The 
spatial single-scale reaction network on time scale dt, where Assumption 13.61 
holds, satisfies the following conditions: 

(i) For Poisson processes {Yk)keK.t^ the time change equation 

S{t)=m+ E f ~^kHS{u))du) + E Ck t~^^HS{u))du 

(3.6) 

has a unique solution 5 := (5(t))t>o, where 

\'i''{s)■.= ^^J2>^M{V.,)\ (3.7) 



d&V 



(ii) same as (iii) in Assumption 12.141 for all d G D. 

Theorem 3.9 (Heterogeneous single-scale system). Let Vj^ := {y_^{t))t>o be 
the vector process of resettled species ttmounts for the rettction network which 
is the unique solution to ()3.3p . Assume that {a, (3,^ = 0) satisfy (j2.10p . i.e. 
we are dealing with a single-scttle system within compartments and r]i = rj > 
for all i € X. Set S^{t) = {S^{t))i^i with S^{t) := Y^dev^idi*)- Suppose 
5^(0) ^~^°^> S_{0) and that Assumptions [Ql and \3.8\ for the resettled rettction 
network hold. Then, the process of resettled species sums, S_^ {■) converges weakly 
to the unique solution S_{-) of (13. 6p in the Skorohod topology. 
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Proof of Theorem \3.S{ In the heterogeneous reaction network we have |X| x 
\T)\ species, one for each type and each compartment, with rescaled amounts 
Vj^ . Movement between compartments can be viewed as (at most) |D| x 
first order reactions involving only species of the same type i G I in different 
compartments, with net change in compartment d of {&d" {d) — Sd' {d)) [d' ,d")e.Vy.v 
at rate {A^^, c?', d" G V}. This set of reactions together with the original 
reactions within each compartment give an overall network in which all the 
species with {i,d) G X x D are fast, whose conserved quantities is a vector 
of sums over all the compartments for each species type, which are given by 
Sf := Y^dev^id ^ Since rn > d,i ^ Z the movement reactions change 
all the species amounts on the time scale dt, and its effective changes on 
this time scale are still [5(i"{d') — ^d'{d"))[d' ,d")^Vx'D while the original within 
compartment reactions effectively change only the conserved sum quantities on 
the time scale dt and its effective changes on this time scale are given by C,* . 

In order to apply Lemma 12.201 set e := rj and we need to check Assump- 
tions 12.191 In this special case that there are no slow species only fast species 
and conserved quantities. Condition (i) is simply the requirement that - in the 
limit — 7- oo - for fixed given vector of sums of species movement leads to a 
well defined process on the species amounts in different compartments, which 
for each value of the vector of sums s has a unique stationary probability mea- 
sure Ps, which is concentrated on Ylid&v'^id = Si- This is exactly implied by 
Lemma fS. 71 under Assumption l3.61 Conditions (ii) and (iii) in Assumptions 12.19] 
is assumed in the statement of the Theorem. 

Let us consider the dynamics of the conserved quantities. Here, 6^' = 
(lj^i)j^x,d<=v is the ith conserved quantity. On the time scale dt the reaction 
dynamics of these conserved sums is a Markov chain whose effective change is 
given by the matrix = C* with overall rate equal to a sum of the individual 
compartment rates. ~ ~ 

Since the equilibrium for the movement dynamics is given by 

Ps{dv)= n ( )7ri{ir'^---7r,{\V\r\^\ 

- - %^ ■ ■ ■ Vi\v\J 

(3.8) 

• n ^T^.{i)s.i.dvii) ■ ■ ■ 
the averaged rates for reaction dynamics in each compartment under the equi- 
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librium probability measure as considered in (|3.7p are exactly of the form (|2.36p , 

^l--T,d^ld=Sl ^\x\.-J2d^\X\d=S\X\ d&V 



iGI 
c«i=0 



(3.9) 



= Ee.[aL^Z.,)]. 

del? 

This concludes the proof of the Theorem. □ 

Corollary 3.10 (Mass-action kinetics). Let a, f3 , 'y , t] be as in Theorem \3.9l If 
the reaction rates are given by mass action kinetics, i.e. 

A.T(2^.,) = n '^^^T) ■ n <^ (3.10) 



holds for some Hkd,k € /C,(i € then the limit of S_^{-) in the Skorohod 
topology is the solution of h3. 6]) with rates given by 



If ai = for all i (z I, the limit process for the sums is simply a Markov 
chain model for reaction networks with mass action kinetics \2.3\) whose rate 
parameters are 

If however, > for all i G I, the limit process for the sums is the determin- 
istic solution to an ordinary differential equation 

'^^w = ECfcA^''(^w)'^* 

with mass action kinetics 12. 3\) whose rate parameters are i3.11\) . 

Remark 3.11 (Different time-scales for the movement). From the point of 
view of the limit on time scale dt, the parameters for time scale of movement 
of different species types do not have to all be equal r]i = rj; as long as ?7i > 
for all i S Z, it is easy to show that the limit dynamics of S_^{-) is as above. 
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Proof of Corollary ImB We plug (ICTjl into ^M)- This gives 



iSX 
Ci>0 



= ^nkd E ••■ E 

it "1=0 if<.|i|=o 

=E-^^n-^^{;.:)^^(^)"^ e ••• e 

o'i^O ifQi=0 ifQ|2-|=0 

cKj— aj>0 

When = for all i only the first sum in 13.61 exists, whereas when > 
for all i only the second sum in 13.61 exists. □ 



3.4 Spatial multi-scale systems 

We next consider heterogeneous reaction networks on multiple time scales, 
where there is interplay between time scales on which the reaction network 
dynamics evolves and time scales on which the species move between compart- 
ments. We give results for chemical reactions on two time-scales, extensions to 
more are obvious. 

We stick to our notation from Section 12. 4[ In particular, we assume the 
reaction dynamics (within each compartment) has a separation of time scales 
(|2J3]1 with e = 1,7 = 0. We set /C^ and as in (fZTil) and (fZT6]l . respectively, 
and and X* for the sets of fast and slow species, if only chemical reactions 
within compartments are considered. The scaling parameters for movement 
of all fast species is r/j = r]f for i G X^ while for all slow species is rji = 
r]s,i € X^. Considering the case r]^ > 1 for the moment, we note that for 
z G X-^ the variable Vj^ (•) changes on the time-scale A^-'^ dt (due to movement), 
whereas S^^ {■) = X^deD ^Jd (') ^^^y changes on the time-scale N dt (due to fast 
reactions). Therefore, in order to assess the interplay of dynamics on different 
time scales, we need to consider all possible orderings of e = 1,?// and r]s. 
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In the sequel, we assume that r]f,i]s ^ 1 for simphcity. Moreover, the cases 
Vs 1^ Vf < ^ ^-iid ?// < rjf < 1, as weh as 1 < i]s < r]f and 1 < rjf < rjf < 1 lead 
to the same limiting behavior, because the movement processes occurring on 
the time scale N'^f dt and A'^''" dt are independent. Therefore, we are left with 
the four cases 

(1) 1 < T]s,Vf; (2) Vs<l< Vf, (3) Vf<^< Vs] (4) Tlf,r]s < 1. (3.12) 

As in the non-spatial situation, we also need to distinguish the cases when (i) 
there are no conserved quantities on the time scale of fast species (meaning that 
M{{C^y) is the null space), and (ii) when some quantities are conserved (i.e. 

MiiC^Y) = span(e-^), where 9-^ = (r^i =1 ... nf is ^ linearly independent family 

of RI-^^ I -valued vectors). In the latter case, the quantities {0'^\V^^ {'))i^if) also 
change on the time scale N'^^ dt for S P by movement of the fast species, but 
{6_'^\ (S'/^(-))jgj/) is constant on the time scale A^^-^ dt. We start with the case 
of M{{C^Y) = nuh space. 

No conserved quantities on the fast time-scale 

We need to consider different processes of possible effective reaction dynamics 
for fast species and their sums, conditional on knowing the values of the slow 
species. In each of the four cases above we need to consider different intermedi- 
ate processes and assumptions on them. We write here, distinguishing fast and 
slow species, g = {gj:,gj with = {vid)i(zxf ^^v^ g^ = ivid)ieX'',dev, as well as 
s = (s/, sj, sj- = {si)i(,xf, = (si)ie2:». 

Assumption 3.12 (Dynamics of the spatial multi-scale reaction network). In 
each case (l)-(4) the spatial two-scale reaction network on time scale N dt, 
where Assumption 13.61 holds, satisfies the following conditions: 

(i) (1) For Poisson processes (^fc)^g^/, the time-change equation of the dy- 
namics of <Sj given the value of S_g = 

t Jo 

-F ^ 



(3.13) 



has a unique solution, where for all Sj,s^ 

Afe^^^^(s/,sJ = j J2^kdiv-dj,V-d,s)'P(sf,sj{dgj^,dgJ < oo, 



(3.14) 



where v.^j = {vid)iizxf ,v.d,s = {vid)iex-, for P(s^,^J a product of multino- 
mial and point mass probability distributions for both Vj. and defined 
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in (j3.8p . In addition, (•) has a unique stationary probability measure 
f^s^dsf) on M^^'. 



(2) For Poisson processes {Yk)f^^j^f, the time-change equation of the dy- 
namics of 5 J given the value of = 

— * r ^ JO ~" 



has a unique solution, where for all Sj,y_ 
rCR(2) 



f JO ~° 



(3.15) 



1/'^.) = E AL^ferf,/,2Z..,jP,,(ci^P < oo (3.16) 

for P^^. a product of multinomial and point mass probability distributions 
as in (j3.8p . where X is replaced by X-^, s by and vhyVj- In addition, 

\xf\ 

(•) has a unique stationary probability measure fi^ (dsj) on Ml^, . 



3) For Poisson processes {Ykd)j^^j^f ^g^,, the time-change equation of the 
lynamics of given the value of S_g = s^. 

f 

f 
fcG/Ci 



has a unique solution, where for all Vj,Sg 



(3.17) 



>^M^'\v.ci,f,s,) = /|,.,,|,, >^'^fiv.dj,v.d,s)PsM^J < OO (3.18) 

i/ IR_j_ 

for a product of multinomial and point mass probability distributions 
as in p.8p . where I is replaced by I**, s by and by w^^. In addition, 
—f\s ^'-^ ~ (V^rfjis^ (•))«ei^',dGi' '^^s ^ st^t^o^^^y probability measure 

/.fs [av ) on M!, ' ' '. 
~* — / 

(4) For Poisson processes {Ykd)j^^f^f ^^jy, the time-change equation of the 



dynamics of given the value of = 



JO 

(3.19) 



fcG/C{ 
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has a unique solution with unique stationary probabihty measure jiy (dv,) 

=s —J 

on I ^1^1^ Here, we set 

aL^^'^ := AL^. (3.20) 
(ii) There exists a weh defined process S_g{-) that is the unique solution of 



i,r-irs -^0 



(3.21) 



where rates (A^^*'^^)j=i_2,3,4 are given from (A^^^^^)£=i_2,3,4 in each case 
as for all 



-s 



Af^'^(^J= / A^''^'^(l/,lJ/^,.(dl/) (3.22) 

A^^^'^UJ= / / x'',''^'\sf,gJf^AdSf)PsM^J (3.23) 
= / / / Afccf(l!.d,/,ll.d,s)Ps^('^^.)/^^^('^^^)Pi,(^^^3) < oo; 



Ar^'^(lJ = E / (3.24) 
= E / / Afccf(2!.d,/,2!.d,JPs,(d^J%,(d^.) < oo; 



Ar^'^(^s) = E / / Af^'^(%>^.)/^2.(%)P..(rf^.) (3-25) 

= E / / Afccf (2Z.d,/,2Z.d,J/^^^(c^^^)Ps,(c^^,) < oo. 

(iii) same as (iii) in Assumption 12. 141 in each compartment. 

Remark 3.13 (Equivalent formulation). For the dynamics under the above 
assumption, the following is immediate: In each case (l)-(4) the spatial two- 
scale reaction network on time scale dt, where Assumption 13.12] holds, satisfies 
the following condition: for Poisson processes (l^OfceACg) the time change equa- 
tion (I3.2ip has a unique solution, where for all Sg 

{ss) ■■= E,, [ E >^m{VM < (3.26) 
dev 
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and the distribution of (yid)iex,dev in (|3.26p depends on the parameters ris,rif 
as fohows: 



{l)= 


=(1) 




.dv ) 

=s' 


■/ IR._|_ 


(3.27) 


{l)= 


=(2) 




Av ) 

=s' 




(3.28) 


{£)= 


<3) 




dv ) 

=s' 




(3.29) 


{£)= 


=(4) 




.dv ) 

=s' 


= Ps^dg^fi^^idg^). 


(3.30) 



We can now state our results for the limiting behavior of S_J := {Sj^ ,i € X-^) 
and := (5"/^, i G I^) on the time scales N dt and dt. 

Theorem 3.14 (Two-scale system without conserved fast quantities). Let 
:= {V_^ {t))t>o be the vector process of resettled species ttuiounts for the re- 
action network which is the unique solution to (j3.3p . Assume that {a,f3,'-f = 0) 
satisfy (j2.13p for some 1^,1" with e = 1 and A/'((C-^)*) = (with from 
(|2.15p )■ i.e. we are dealing with a two-scale system within compartments with- 
out conserved quantities on the fast time-scale. In addition, r]i = rjf > for 
all i ^ and rji = r]s > for all i € I* and one of the cases (1)~(4) holds. 
Suppose A ssumption \3.1^ holds. Then, the rescaled sums of slow species S_^ (•) 
from (j3.4p converges weakly to the unique solution S_g{-) of (j3.2ip in the Sko- 
rohod topology. 

Remark 3.15 (Interpretation). The rates in Theorem 13.141 have an intuitive 
interpretation. In all cases, in order to compute [A^J^(y.^)] , we have to know 
the distribution of V_ given . 

Consider case (1) as an example. Here, since movement of particles are the 
fastest reactions in the system, given the value of 5^ = s^, (i) are distributed 
according to Ps^{dvJ from (j3.8p . and (ii) <S/ is distributed according to the 
probability measure fis^idsjr) from Assumption 13. 12T i) (1 ) : then, given the value 
of S_j- = S/, the values of are distributed according to Ps^{dvj-) (13. Sp . 

Another case is (3) since fast reactions within compartments and move- 
ment interacts. Here, given the value of S_g = s^, (i) again are distributed 
according to P^^^ from (|3.8p . but (ii) V_j, are distributed according to fj:s^{dvj-). 

Proof of Theorem \3.14\ The proof relies on use of Lemmas 12.181 and 12.201 Let 
us first consider the case (1): ?//,?7s > 1- In this case on the two fastest time 
scales N'^f dt and N^" dt we have movement of fast and slow species respectively, 
whose sums are unchanged on any time scale faster than N dt. Regarding the 
movement as a set of first-order reactions as in proof of Theorem 13.91 we have a 
three time-scale dynamics: movement of all species is the fast process on time 
scales A^''^ dt, N"^" dt, effective change of fast species is the medium process on 
time scale N dt, and effective change of slow species is the slow process on 
the time scale dt. The fast process of movement of all species has a stationary 
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probability measure that is a product of multinomial and point mass probability 
distributions P(sj.,s ) from (jS.Sp . Arguments from Lemma 12.201 imply that on 

the time scale N dt all rates for the reaction network dynamics A^^*^^^ are sums 
over compartments of rates averaged with respect to P(5^,^^j as in (j3.14p . and 
the medium process of the sums of fast species S_j has effective change given 
by C'^. Condition (i)(l) of Assumption 13.12] ensures that on time scale N dt the 
medium process S_j{-) is well defined and has a unique stationary probability 
distribution fJ^s^idsj). Condition (ii) of Assumption 13.12) then ensures that, in 
addition to conditions (i-a) and (i-b), also condition (ii) in the Assumptions for 
Lemma [2.18l is met, and consequently the limiting dynamics of the slow process 
S_g{-) with effective change given by ^-^ is well defined and given by the solution 
of (IH:^ with rates as in (^7F2\\ . 

Next consider the case (2): rjf > IjTJs < 1. In this case we have a four 
time-scale dynamics: movement of fast species is the fast process on time scale 
N'^f dt, effective change of fast species is the medium- fast process on time scale 
N dt, movement of slow species is the medium-slow process on time scale N'^" dt, 
and finally effective change of slow species is the slow process on time scale dt. 
The fast process on time scale N^f dt of movement of all species has a stationary 
probability measure that is P^^. (j3.8p (over i G only). Lemma 12.201 implies 

that on the next time scale N dt rates x^^^"^^ are averaged with respect to 
as in (j3.16p . and the medium- fast process has an effective change given by 
. We now have that this process is well defined and has a unique stationary 
probability distribution fi^ (dsf). Furthermore, on the next time scale N"^" dt 
we only have the movement of slow species, which has a stationary probability 
measure that is P^^ (|3.8p (over i G X'* only). Finally the limiting dynamics of 
the slow process S_g{-) on time scale dt, by an extension of Lemma 12.181 to four 
time-scales, is well defined and given by the solution of (j3.2ip with rates as in 

Let us next consider the case (3): 7]f < 1,7/^ > 1. We again have a four 
time-scale dynamics: movement of slow species is the fast process on time 
scale A^''" dt, effective change of fast species is the medium- fast process on time 
scale Nt, movement of fast species is the medium-slow process on time scale 
N^f dt, and finally effective change of slow species is the slow process on time 
scale dt. Lemma 12.201 implies that on the medium- fast time scale N dt rates 
^kd^^^^ are averaged with respect to P^^ ()3.8p (over i € X* only) as in ()3.18p . 
and the medium-fast process y_j. has an effective change given by C'^ in each 
compartment d ^T>. This process is well defined and has a unique stationary 
probability distribution fJ,s^idVj,). On the next time scale A^^" dt we only have 
the movement of slow species, which has a stationary probability measure that 
is Ps^. ()3.8p (over i Gl^ only). Finally, on time scale dt. Lemma |2 . 1 81 extended 
to four time-scales implies the limiting dynamics of the slow process S_g{-) is 
well defined and given by the solution of p.2ip with rates as in p.24p . 

Finally, we consider case (4): r]f < l,r]s < 1. On the fast time scale N dt in 
each compartment d ^T> independently we have reaction dynamics of the fast 
species, with a unique equilibrium /.f^, {v_ ) that must be a product distribution 
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over the different compartments. Similarly to case (1) when all the movement 
is fastest, we now have all the movement to be on the medium time-scale, with 
a unique stationary probability distribution P(s^..s ) (I3.8p (over all i € I), which 
implies that on the slow time scale dt, the effective change of S_g is due to reaction 
dynamics with rates A^^'^(?;^, w^) that have been averaged over P^^^^sj, and 
is given by C'^. Again Lemma [2.181 implies that S^(-) is well defined and given 
by the solution of (j3.2ip with rates as in (I3.25j) . □ 

If the movement of fast species is slower than fast reactions (i.e. we consider 
case (3) or (4), the equilibria for reactions is always attained before movement 
of fast species can change this equilibrium, as stated in the next corollary. 

Corollary 3.16 (Irrelevance of movement of fast species). In the situation of 
Theorem \3.14\ cases (3) or (4), the limiting dynamics of S_g is independent of 

Proof. Actually, the assertion can be seen directly from (|3.29|) and (|3.3U|) . since 
the right hand sides do not depend on Ps^- D 

If all slow species are continuous, the limiting dynamics for cases (1), (2) and 
(3), (4) are equal. The key to this observation is the following lemma. 

Lemma 3.17. In the situation of Theorem \3.14\ assume = 0, i.e. all slow 
species are continuous, and let tts^ := {T^i{d)si)i^x'> ,d&v- 

(i) For stationary probability measures fj,s^{dsjr) of S_j\g from Assumption \3. 1^ 
(i)(l) and fi^ (dsj) of S_f\y from (i)(2), we have 

fJ-s^dsf) = fi^^idsf). 

(a) Likewise, for stationary probability measures fis^{dv J.) ofV_j.^^ from (i) (3) 
and /i„ {dVj) of y__i,^^ from (i)(4), we have 



Proof of Lemma \3.17\ (i) It suffices to show that /x^ is a stationary probability 
measure for the process (•) from (I3.13|) . since we assumed that this process 
has a unique stationary probability distribution. Clearly, the process (•) is 
a strong Markov process with generator 

Lf\s^gisf)= Xk^^^\sf,s,) g{sf + C{) -9{sf] 

k£K.i 
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Note that, by independence of the movement of fast and slow species, for k € K.-^ , 



^CR(l) 



dev 

= [ T.^kfill-dj^^-d,s)Ps,{dE^)PsM^J 

deV 

Hence, 

+ / ~^k^^^\^f^^s)dsj9{sf)-C{f^^^idSf) 

fc6/C{ 



keK: 



f 



keici 



since //^ (dSf) is an equiUbrium for S_f\^, (•) from (2). (ii) foUows along similar 
lines. □ 

Corollary 3.18. Consider the same situation as in Theorem \3.14\ assume 
that = %, i.e. all slow species are continuous. Then, the dynamics of (j3.2ip 
is the same among the first two cases (1) and (2), and among the last two cases 
(3) and (4). 

Proof. Since Ps^{dv_^ is the delta-measure on vrs^, all assertions can be read 
directly from (I3.27p - p.30p together with Lemma 13.171 □ 

We end the results on multi-scale chemical reaction networks in spatial setting 
by noting that the case (1) (where all species move faster than the fast reactions 
occur) plays a special role under mass action kinetics. 

Corollary 3.19 (Homogeneous mass-action kinetics). Consider the same situ- 
ation as in Theorem \3.14\ and assume that the reaction rates are given by mass 
action kinetics with constants satisfying the homogeneity condition 

Kk ■■= mfikdYiT^iidY"'. 

Then, the dynamics of S_g in case (1) is the same as for the system regarded as 
a single compartment. 
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Proof. For (1) from (|3.14p we only need to calculate the average with respect 
to equilibrium of the movement dynamics for both slow and fast species. The 
same calculation as for mass-action kinetics in Corollary 13.101 we get the first 
equality in 

^k^^^\sf,sj = Y^ / Xkdi:il-d,f,v-d,s)^is^,sjidgj,dg^) 

= E '^'^^ n ^^k'■('')Md^' ■ n iMd)s^r' 



--■n ".'<,:;) n-r-- 

Since the right hand side gives the reaction rates for mass action kinetics within 
a single compartment, as given through y_j^^ from ()2.19p . the equilibrium 
Hv^{dz) from Assumption 12 . 14( 1) and from Assumption l3.12n )(l) must 

be the same and the assertion follows in the case without conserved quanti- 
ties. □ 

Example 3.20 (Two time-scale kinetics in multiple compartments). We take 
up kinetics from Example 12.161 and extend it in a multi-compartment context. 
Recall that the chemical reaction network is given (within compartments) by 
the set of reactions 

We consider A^^(x) as in (j2.23p with k'^ replaced by k'^^, k e {1,2,3}. We 
have X = {x.j)d£V, X-d — {^Adj^Bd), and the dynamics are given by 

A^f (^.d) = f^'^d^AdXBd, ^zlix-d) = 4, A^i^fed) = n'^XBd- 



Movement of species is given as in (13. 3p . The scaling in each compartment is 
as in the non-spatial setting (j2.24p . (j2.25p and (j2.26p . so the rescaled species 
counts are 

VAd = N~^XAd, VBd = XBd, 

and rates are 

^Effed) = l^i-dVAdVBd, >^^f{v.d) = l^2.d, A^^(i;.rf) = K2dVBd- 

Now, the process = (V^, V^) is given as in ()2.27p and additional movement 
terms. We set "qg = tja for movement of slow species and rjj = i]b for movement 
of fast species. We assume (as in Assumption 13. 6p that movement of species 
A, B have stationary probability distributions (vr^((i))rfGD and {i^ B{d)) d£V ■ We 
derive the dynamics of Sa as 



SA{t) = SA{Q)- f}P\SA{u))du 
Jo 
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for appropriate A. Since the slow species A are continuous, we are in the regime 
of Coroharv 13.261 and we distinguish the following two cases: 

Dynamics in the cases (l)+(2): We have 

SslsAi^) - SbIsa^^) = / / X] f^^dVAdVEdP (sA,3B\sJu))idVA, dvB)du 

+ Yz(^Yl '^^'^*) ~^^{ f '^idVBdF(sA,SB^,Ju))(.dVA,dVB)du 

dev •'^ dev 

= -^i+3( / (^^Kj_d7rA{d)7rB{d)sA + ^HidT^B{d)^SE\ssiu)d- 

''^ dev dev 



dev 

= :Rz 

Hence, the equilibrium of the above process is as in Example 12.161 given by 
X ~ ^s^{dsB) = Poisf ^ — ) 

We can now compute A'~'^'^^)+'^^) from (|3.22|) as 

^CR(i)+(2)(^^) = -A^^l^(i)+(2)(,^) = _ j J2^.d7rA{d)sA7rB{d)sBf^sAidsB) 

'^!.^ _ _ (3.31) 
KidT^AidjSA-n-Bid)- — — = - — — . 

K3 + K^SA K3 + K^SA 

Dynamics in the cases (3) + (4): We have in each compartment d G P 

^b.IsaW -^b.Isa(O) = / ^^idVAdVB,\sAi^)PsAidvA,)dy) +Y,(^K,dt) 

~^i{J^ / '^i'^^^tl'^i'^^^SAidvAjdu^ 

= ( j [i^i.d-^A{d)sA + K^d) ^BalsA iu)dv}j + (^K^dt^ . 

Hence, the equilibrium of the above process is 
X ~ UsAidvBa) = Pois 



Kzd 



i^id + Kj_d7rA{d)sA 



and for AC^(3)+(4) f^^^^ 

we have 

-XCm)+W(^SA)=-Yl j K.dVAdVBdt^SAidVB,)PsAidVA,) 



dev 



(3.32) 

Kj^dKzdT^AjdjSA 
l^id + H:,dT^A{d)SA' 
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Comparison of dynamics in cases (1) + (2) and (3) + (4) 

Let us compare the case (l) + (2), when the turnover rate of A is given by (I3.3ip . 
and (3) + (4), when the rate is given by ()3.32p . First note that even when the 
network is spatially homogeneous (the chemical constants satisfy assumption 
in Corollary I3.19P there is a marked difference between the dynamics of cases 
(1) + (2) (as in single compartment case) and cases (3) + (4) depending on the 
movement equilibria tta and ttb- However, if we additionally suppose the slow 
species A are equidistributed iTAid) = 1/|P| then all four cases have the same 
dynamics. 

Conserved quantities on the fast time-scale 

Now, we include conserved quantities in our two-scale system in multiple com- 
partments, i.e. we have a two-scale reaction network with dim(A/'((C'0*) 

> 0. We will use the same notation as in Section 12.41 In particular, := 
{§.^^)j=i nf linearly independent vectors which span the null space of (C'^)*- 
Every 6_^^ has a unique parameter Oi associated with it, j = 1,..., = . 
Here, 0{ is the subset of conserved quantities for which = 0, and G{ is 
the subset of conserved quantities for which > 0. Conservation means 
that t H> {e^\ S_j\^^{t)) with S_f\^^ from is constant, j = l,...,|e^|. We 

let 5^ = {0^^ -jSjj) and = {S^.)i=i^^^^^\Qf\ be the vector of rescaled con- 
served quantities. Again, /Cgc^ is the set of reactions such that /3fc = and 

(^'^Cfc) / 0, and let /C^ := Ul=i' /Cgs, ]C% := [jfj} ICgj, and /C^ := \jfj} ICgj, . 
We stih assume that /C^ n /C^ = (see (j2.34p ) and let C'^ be the matrix defined 
by (1233]) . 

Again, we consider the four cases as given in (j3.12p . In addition, we as- 
sume that {0'^^,S_^) changes on the time-scale dt. We write here, distinguish- 
ing fast species, conserved quantities and slow species, v = {Vj,,v^,vJ with 

gj^ = {vid)i(.xf4&v^ = ((^''^2^.d,/))i=i,...,|0/|,dGX>' = Miax-.da-D, as well as 
s = isf,s^,sj, Sf = {si),^xf, s^ = ((^'^M/))j=i,„„|e/|, and = (si)iex-- 

Assumption 3.21 (Dynamics of the spatial multi-scale reaction network with 
conserved quentities). In each case (l)-(4) the spatial two-scale reaction net- 
work on time scale N dt, where Assumption 13.61 holds, satisfies the following 
conditions: 

(i) (1) For Poisson processes (1^)^^^/, the time-change equation of the 
dynamics of 5j given the values of S_g = s^ and = s^, denoted 
(.^f\{s ,s ){'t))t>o, given by (|3.13p with S_j^g replaced by S^k^ ), has 
a unique solution, where A^^'^^^(sj, s^) is given by (|3.14p . In addition, 
^/|(s ,s )(■) ^ unique stationary probability measure IJ'(s^,s^)idSf) on 

' with {6^\Sj) = Sep /i(s^^s^)-almost surely, j = 1, 

(2) For Poisson processes {Xk)j^^^f-, the time-change equation of the 
dynamics of 5j given the value of V-^ = and -S^ = s^, denoted 
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(S/K^ ,s^){t))t>o, given by (|3.15p with S_j^^ replaced by S_f^(^^ ^^j, has 

a unique sohition, where {§.f,vj is given by (I3.16|) . In addition, 

^f\{v ,s )(■) ^ unique stationary probabihty measure fj,(^y ,s^){dsj) on 

M!^ with {9''\Sf) = Scj, ^^j-almost surely, j = 1, jO'^l. 



(3) For Poisson processes iykd)^^^f ^g^)' time-change equation of the 
dynamics of V-j given the values of S_g = and = v^, denoted by 
(Kf\(s^,v )(*))<>0' given by (|3.17|) with replaced y.dj\{s^,gj^ has 

a unique solution, where A[J'j^^^^(2;^, s^) is given by (|3.18|) . In addition, 
~f\{s V )^'^ ^ unique stationary probability measure fJ-is^^v ){dv_j) on 

^i^ii {9^3 ,v^) = v^., fJ.(s^.v )-almost surely, j = 1, 
Moreover, given Sg and s^, the movement dynamics of Y.^^^^ s ) ^ unique 
solution I^^K'g ^ )(■) = (l^.d,c|{s ,s ))dev of the time-change equations 

(r^Z..,/)|(,,,,J(^)-r^Z..,/)|{,,,,J(o) 

i^xf d',d"&V 

■Yd',d",i{J ^f!d',d" J 9"' eQi, 

° ' (3.33) 

(r^Z..,/)|(,,,,J(^)-r^Z..,/)|{,,,,J(o) 

■/^('^s.^ Au)){dv )du, 9"^ ^qI, 

with an equilibrium probability distribution of movement P^^ ){dy_^ 
with Y.d&vy-d,c = Sc, P(^^,sj('^^J-almost surely. 



(4) For Poisson processes iYkd)j^^f^f ^g^)' time-change equation of the 
dynamics of given the values of V-^ = and = v^, denoted by 
^=f\{ii S^^^^ *EI9D with V.dj\^^ replaced by 

~ C^Ti (A\ 

has a unique solution, where A^^ {UpV.^ is given by (j3.20p . In addition, 
—c\(v V ) ^ unique stationary probability measure //(^ ){dv_^) with 
(^"^^P = l!cj, /i(^^,^^)-almost surely, j = 1, |e^|. 

Moreover, given v and s^, the movement dynamics of y ,, , is a unique 

solution V_ , = iy_.(ic\(v s ))dev of the time-change equations (j3.33p 

with V_ , replaced by y ,, , with an equilibrium probability dis- 

tribution of movement Pt^ g \ {dv ) with Yldpv'^-d c — '^{v s )-almost 
surely. 
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(ii) From {X^"}i =1,2,3,4, we set in each case 

Afc {ss,sj = \ (3.34) 

Ar^'^U.,lc)= / / Afc''^'^U/>^.)^fe^,.j(^l/)P^.(rf^.); (3-35) 

]g|e-f|x|D| jg|i/|x|D| 

(3.36) 

R^i^|xp|j^^e/|x|i.|j^^i/|x|i.| 

(3.37) 

For j = 1,2,3,4, there exists a well defined process {S_g{-) ■, S_f.{-)) that is 
the unique solution of 



I . r- ys J 



(3.38) 



and for j = 1, 

Sc^{t) = Sc^{t) (3.39) 



fce/cg iex/ 



(iii) same as (iii) in Assumption 12 . 141 in each compartment. 

Remark 3.22 (Equivalent formulation). For the dynamics under the above 
assumption, the following is immediate: In each case (l)-(4) the spatial two- 
scale reaction network on time scale dt, where Assumption 13.21] holds, satisfies 
the following condition: For Poisson processes (^fc)fcGA:g) the time change equa- 
tions ()3.2ip has a unique solution, with A^^ as in (|3.26p . The distribution of 
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{VidjieXAev in (|3.26p depends on the parameters ??s,?7/ as follows: 

(4) 

(3.43) 

Theorem 3.23 (Heterogeneous two-scale system with conserved fast quanti- 
ties). Let := {V^ {t))t>o be the vector process of rescaled species amounts 
for the reaction network which is the unique solution to (j3.3p . Assume that 
{Ql) /3) 7 = 0) satisfy ()2.13p for some 1^,1" withe = 1 andMiiC^Y) = span{ef) 

(with from ([2351) and Q-f from ([232]) ). i.e. we are dealing with a two-scale 
system within compartments with conserved quantities {O^^'^^^^ jQ/j on the fast 
time-scale. In addition, rji = rjf > for all i S Z-^ and rji = rjs > for all i G I'^ 
and one of the cases (1)~(4) holds. Suppose Assumption \3.21\ holds. 

Then, we have joint convergence of the process of rescaled amounts of the 
slow and conserved quantities {S_^ {■) , S_^ {■)) =^ {S_g{-) , S_^{-)) in the Skorohod 
topology, with S_g the solution of \3. 3^) and S^ the solution of ^3. 39\) with rates 
given by (3^-(3^. 

Proof. The proof follows the exact same lines as that of Theorem 13.141 Care 
must be taken only with respect to the movement of conserved species in cases 
(3) and (4) for which extra assumption of well defined movement rates were 
made in Assumptions [3^211 □ 

We point out that the analogous result of Corollary 13.161 of irrelevance of the 
movement of fast species in cases (3) and(4) does not carry over to the case with 
conserved quantities. The reason is that because of the existence of conserved 
quantities, on the time scale of the movement of fast species, the conserved 
quantities of the fast reactions are still preserved. 

We now derive results if all slow species and all conserved quantities are con- 
tinuous. Again, we will show that the limiting dynamics for cases (1), (2) and 
(3), (4) are equal. 

Lemma 3.24. In the situation of Theorem \3.23\ assume = 0, i.e. all slow 
species are continuous, and let tts^ := {i^i{d)si)i^x'>,d&v- 

(i) For stationary probability measures ^(^s^s^){dsf) of S_f\i^g from Assump- 
tion \3.2l\ (i)(l) and fi^^y ,sjidsj-) of S_j^(^^ ^ ^ from (i)(2), we have 



= PsMgs^ f .^i^^s,{d^f)l^{s,,s^){dsj), (3.40) 
= ^sM^) I^^Ps,{d^j)li(^^,s^){dsj), (3.41) 

J M_|_ 

= ^sSd^) / |e^|,|^| /^(s.,^^)(f^%)P(s„sj(^^^,), 
J M_|_ 

(3.42) 
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(ii) Likewise, for stationary probability measures ){dv^) ofy_j,^^^ ^ ^ from 

(i)(3) and H(^^^^^j{dg^) o/Zj|(^ „ ) from (i)(4), we have 

Remark 3.25 (Conserved quantities as new species). In previous results, con- 
served quantities on the fast time-scale can often be handled in a way as if they 
are new chemical species, evolving on the slow time-scale. We stress that the 
lemma does not require that Go = 0, i.e. that there are no conserved discrete 
quantities. If there are conserved discrete quantities, they form a jump process 
on the time-scale dt, but the changes in the conserved quantities are made due 
to the movement between compartments on the time-scale A^^-^ dt. 

Proof of Lemma \3.24\ The proof follows in full analogy with the proof of 
Lemma 13. 17^ once we exchange fJ-s^idsj) by lJ'{s_^,sj{dsf), iJ,v (dsf) by 
/^(^,.ic)(^^/)' ^^"^ l^v{dg^) by H{^^,yj{d-g^). □ 

Corollary 3.26. Consider the same situation as in Theorem \3.23\ and assume 
that = 0, i.e. all slow species are continuous. Then, the dynamics of p.38p 
is the same in the cases (1), (2) and (3), (4). 

Proof. Since Ps^{dv^) is the delta-measure on tts^, all assertions for (1), (2) 
can be read directly from (j3.40p - (13.4ip together with Lemma I3.24[ For (3), 
(4) we need also to examine the effect of the equilibria of movement of the 
conserved species P(^^ and P(„ ^s^){dvj in the two cases. The move- 

ment of conserved species is determined by the expected value of the fast 
species with respect to the equilibrium probability measure for the faster reac- 
tion dynamics lJ's^,s^{dv ) and fiy ,s^{dv ), respectively; see (j3.33p and the same 
equation with V_ , replaced by , , , . By Lemma 13.241 they have the 

same form when is replaced by tts ^. For O'^i € &[, the movement dynamics 
for {{0'^^ ,y_.^j)}d£V are given by a Markov chain whose rates have the same 
form in (3), (4) when is replaced by tts^. Hence, the equilibrium distribu- 
tions for these Markov chains have the same discrete probability distribution 
given the above stated replacement. For 6"^^ S &(, the movement dynamics for 
{{0'^^ ,V_.dj)}dev are given by solutions of ordinary differential equations whose 
vector fields also have the same form in (3), (4) when is replaced by tts^, 
and hence, their equilibria are point masses of the same form given the stated 
replacement. Since the overall equilibrium distribution of movement of all con- 
served species is a product of the multinomial and point mass distributions 
their forms satisfy P(s )idvj = P(^s ){dy_^. From this the rest can be read 
from (l3:i2D - (l3:i3]) ~' □ 

Corollary 3.27 (Homogeneous mass-action kinetics). Corollary \3.19\ carries 
over to the same situation as in Theorem \3.23l 

Proof. The proof is actually the same as in the case without conserved quantities 
in Corollary [3T9] because the effect of the conservation is the same for the single 
compartment model from Corollary 13.101 as in the proof of Corollary 13.191 □ 
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A canonical application of Theorem l3.23l is a spatial version of Michaelis-Menten 
kinetics. Since this case also has a number of special features, we defer this 
application for future research. 



4 Discussion 



Specific features and extensions of spatial chemical reaction models. 

a. Heterogeneous reaction and migration rates. The reaction rates 

in general depend on the compartment d. For the same reason, the outflow 
of species i from compartment d', '^d"ev -^fli' d" might depend on i and d'. 
Moreover, it is possible that A£^(x.^) is zero for some compartments, i.e. our 
model is flexible enough to restrict some reactions to a subset of compartments. 
Analogously, movement of certain species types can be restricted to only a 
subset of compartments, that is A^^^, can also be set to zero for some i,d,d'. 
The only thing which is required that every reaction k happens within at least 
one compartment. 

b. Geometry of space. The geometry of the spatial system is not been 
explicitly relevant for our results. The reason is that movement dynamics is 
assumed to happen at a different time scale (either faster or slower) than the 
effective reaction dynamics of either the slow or fast species. This implies that 
only the equilibrium of the movement is relevant for any dynamics occurring 
on the respectively slower scale. 



c. Chemical conformations. Our model can be extended in order to model 
different chemical conformations of chemical species instead of spatial compart- 
ments. For this, let be the set of possible conformations of species i. Then, 
any molecule of species i performs a Markov chain on Vi due to changes in 
conformation. Moreover, in this case for each type of reaction k its reaction 
rate A^^^, might then depend on all conformations of reacting and produced 
molecules d = {di)i^x and d' = (d^)jgXi respectively. For example, our results 
can be applied to Michaelis-Menten kinetics with r nultiple con formations of the 
enzyme and of the enzyme-substrate complex (see Koul 200^ 



d. Other density dependent processes. The model can also be applied to 
other density dependent Markov chain models, such as epidemic or ecological 
models. Analogous results can also be made for density dependent stochastic 
differential model s of stochastic pop ulation growth in spatially heterogeneous 
environments (see Evans et al. 2013l |). 



Conclusions 

The main conclusion of our paper is the following algorithm for determining 
the dynamics of a spatial chemical reaction network: assume we are given a 
network of the form (j2.ip in a spatial context, i.e. (j3.ip holds with reaction 
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rates as in Assumption 13 . It introduce a (large) scaling constant N and rewrite 
the dynamics of all species in the form (j3.3p (for some ctj's, r^j's and (3k s) 
assuming (12. 6p and ()3.2p hold. (Admittedly, the choice of N, a^'s and /3fc's 
is rather an art than a science - for simplicity we are assuming here that this 
step has been done already); in addition, suppose every species moves between 
compartments as in Assumption 13.61 the goal is to understand the dynamics of 
overall normalized sums of species over compartments as given in (13. 5p . 

There are two cases: either the system is on a single-scale, i.e. (j2.10p holds, 
or the system is two-scale, i.e. (12.13P holds. (We do not treat higher order scales 
in this paper.) 

(i) In the single-scale case Theorem 13.91 applies. Essentially, one has to 
average all reaction rates of reactions affecting slow species over the equilibrium 
distribution of movement of all species. If reaction rates are given by mass action 
kinetics, Corollary 13.101 applies. 

(ii) The two-scale case is considerably more complicated. Here, every species 
is either fast or slow and we have to consider all orders of the time-scale of fast 
reactions and movement of fast and slow species. We call Sf the overall sum 
of normalized fast species and Sg the overall sum of normalized slow species. 
Consider the submatrices of slow and fast reactions, C'^ and (^'^ from (j2.15p 
and (j2.17p . respectively. A conserved quantity for the fast reaction subnetwork 
is a non-trivial element of the null-space of (C'^)*- 

(ii-a) If there is no conserved quantity, we can use Theorem 13.141 Here, 
there are up to four timescales to consider, movement of fast and slow species, 
the timescale of the fast reactions, and the timescale of the slow species. In all 
cases, in order to determine the effective rate on Ss on a slower timescale, one 
has to average over the equilibrium of all higher timescales. Interestingly, if all 
slow species are continuous (i.e. have a deterministic process as a limit), it only 
matters if the fast species move faster or slower than fast reactions. The speed 
of the movement of slow species does not matter (see Corollary I3.18P . 

(ii-b) If there are conserved quantities for the fast reaction subnetwork, these 
conserved quantities can still change on a slower timescale. Here, we are assum- 
ing that: this timescale is the same as the timescale of the slow species, and that 
the rate-determining reactions of the dynamics of slow species and conserved 
quantities on the fast timescale are disjoint (|2.34p . The main difference from 
the case without conserved quantities is that on the fast timescale, the equi- 
libria we need to consider for averaging are concentrated on a fixed conserved 
quantity. Then, basically, the conserved quantity can be treated as new species 
with its own dynamics (which changes on the timescale of slow species by as- 
sumption). Again, there are four cases to consider; see Theorem 13.231 Also, if 
all slow quantities are continuous, it only matters if the fast species move faster 
or slower than the fast reactions; see Corollary 13.261 
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